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CAMERA CONTROL SYSTEM 

BACKGROUND OF THE INVENTION 
Field of "the Invention 
5 The present: invention relates to a camera control 

system and method for remotely controlling a camera 
suitable for use with video conference systems, camera 
monitoring systems and the like. 
Related Background Art 

10 The assignee of the present invention has proposed 

a system such as camera monitoring systems and video 
conference systems, by which a plurality of clients at 
remote sites not only can look at an image picked up by 
a video camera, but also can remotely controlled the 

15 image pickup direction, zoom magnification factor and 
the like of the video camera. 

In such a camera control system, if a plurality of 
clients access the same video camera to control it, the 
controls by these clients cannot be processed at the 

20 same time. Therefore, a system has been proposed in 

which only one client is given a "camera control right" 
at a time. 

In a camera control system incorporating the 
concept of "camera control right", a client may 
25 advertently input a camera control command before an 
acquisition request for the camera control right is 
entered . 



SUMMARY OF THE INVENTION 

It is an object of the present invention to solve 
the above problem and provide a system capable of 
controlling a camera by issuing an acquisition request 
for a camera control right even if a camera control 
command is input inadvertently before the acquisition 
request for the camera control right is issued. 

In order to achieve the above object, one aspect 
of the invention provides a camera control system 
capable of controlling a video camera connected to a 
camera server by transmitting a video camera control 
command from a client, wherein the client comprises: 
input means for inputting a video camera control 
command; and control request transmitting means for 
transmitting an acquisition request for a video camera 
control right to the camera server, when the video 
camera control command is input from the input means, 
and the camera server comprises: permission command 
issuing means for issuing a permission of the video 
camera control right to the client, in response to the 
acquisition request for the video camera control right 
issued by the control request transmitting means of the 
client; and control means for controlling the video 
camera in accordance with the video camera control 
command issued by the client. 

According to another aspect of the invention, 
there is provided a client capable of controlling a 



video camera via a network, comprising input means for 
inputting a video camera control command; and control 
request transmitting means for transmitting an 
acquisition request for a video camera control right to 
the camera server, when the video camera control 
command is input from the input means - 

According to another aspect of the invention, 
there is provided a camera server for controlling a 
video camera in accordance with an input video camera 
control command, comprising control means for 
controlling the video camera in accordance with the 
video camera control command issued by a client granted 
a video camera control right; register means for 
registering the client granted the video camera control 
right; and reception means for receiving the video 
camera control command, wherein if the video camera 
control command from a client not registered in the 
register means is received, the register means 
registers the client if there is no other client 
registered, and the control means controls the video 
camera in accordance with the video camera control 
command . 

According to another aspect of the invention, 
there is provided a method of controlling a video 
camera by a client via a network comprising the steps 
of: inputting a video camera control command; and 
transmitting an acquisition request for a video camera 
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control right to the camera server, when the video 
camera control command is input. 

According to another aspect of the present 
invention, there is provided a method of controlling a 
5 video camera by a camera server in accordance with an 
input video camera control command, comprising the 
steps of: controlling the video camera in accordance 
with the video camera control command issued by a 
client granted a video camera control right; 

10 registering the client granted the video camera control 
right; and receiving the video camera control command, 
wherein if the video camera control command from a 
client not registered is received, the client is 
registered if there is no other client registered, and 

15 the video camera is controlled in accordance with the 
video camera control command . 

According to another aspect of the present 
invention, there is provided a storage medium storing a 
computer readable program for controlling a video 

20 camera by a client via a network, wherein the program 
comprises the steps of: inputting a video camera 
control command; and transmitting a control acquisition 
request for a video camera control right to the camera 
server, when the video camera control command is input, 

25 According to another aspect of the present 

invention, there is provided a storage medium storing a 
computer readable program for controlling a video 
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camera by a camera server in accordance with an input 
video camera control command, wherein the program 
comprises the steps of: controlling the video camera in 
accordance with the video camera control command issued 
5 by a client granted a video camera control right; 

registering the client granted the video camera control 
right; and receiving the video camera control command, 
wherein if the video camera control command from a 

w client not registered is received, the client is 

10 registered if there is no other client registered, and 

*W the video camera is controlled in accordance with the 

CO video camera control command- 

m 

yj The other objects and features of the present 

Q invention will become apparent from the following 

3,ji 15 detailed description of embodiments when read in 

3 ss s cf 
3™: 

^ conjunction with the accompanying drawings. 

CO 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 a block diagram showing the structure of a 
20 camera control system according to an embodiment of the 
invention. 

Fig. 2 is a diagram showing an example of a 
displayed image on a bit map display. 

Fig. 3 shows the software configuration of the 
25 camera control system of the embodiment. 

Fig. 4 is a flow chart illustrating the operation 
to be executed by a camera server. 



Fig. 5 is a flow chart illustrating the operation 
to be executed by a client. 

Fig. 6 is a flow chart illustrating the detailed 
operations of Step S553 shown in Fig. 5. 

Fig. 7 is a flow chart illustrating the detailed 
operations of Step S553 shown in Fig. 5 different from 
those illustrated in Fig. 6. 

Figs. 8A, 8B and 8C are diagrams showing the 
structure of data packets. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
Embodiments of the present invention will be 
described with reference to the accompanying drawings. 
In the embodiments, if a client (computer terminal) 
accessing a remote video camera and receiving video 
data enters a camera control command without acquiring 
a video camera control right, an acquisition request 
for the camera control right is automatically issued. 

Fig. 1 is a block diagram showing the structure of 
a camera control system according to an embodiment . In 
Fig. 1, reference numeral 1-1 represents a camera 
server, and reference numerals 1-2, 1-3, 1-4,... 
represent a client (computer terminal) which can 
control a video camera 1-11, the control operation 
being described later. A large number of clients can 
be connected to a network 1-0. 

The camera server 1-1 controls the video camera 1- 
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11 directly connected thereto. The camera server 1-1 
transmits video data supplied from the video camera 1- 
11 to an accessing client. 

Reference numeral 1-12 represents a video camera 
5 control circuit which controls an image pickup 

direction (pan and tilt angles), a zoom magnification 
factor and the like of the video camera 1-11. 
Reference numeral 1-13 represents a video capture which 
captures an image taken with the video camera 1-11. 
10 A secondary storage device 1-17 stores a program 

fU for controlling the operation of the camera server 1-1. 

y ? 

Eg Reference numeral 1-16 represents a RAM. A CPU 1-15 

iy loads the program in RAM 1-16 and executes it to 

O thereby control the whole of the camera server 1-1. 

l^s 15 A network I/F 1-14 performs data transfer to and 

from a client via a network. Reference numeral 1-18 
^ represents a system bus connecting components of the 

camera server . 

Reference numeral 1-23 represents a bit map 
20 display for displaying an image or the like taken with 
the video camera 1-11. Reference numeral 1-26 
represents an input unit which is a pointing device 
such as a keyboard and a mouse. With this input unit 
1-26, a cursor displayed on the screen of the bit map 
25 display 1-23 is moved to a particular icon to enter a 
camera control command. 

A secondary storage unit 1-25 stores a program for 



con-trolling the operation of the client 1-2. Reference 
numeral 1-24 represents a RAM . A CPU 1-22 loads the 
program in RAM 1-24 and executes it to thereby control 
the whole of the client 1-2. 

A network I/F 1-21 performs data transfer to and 
from the camera server 1-1 via the network. Reference 
numeral 1-27 represents a system bus connecting 
components of the client 1-2. 

The other clients 1-3, 1-4,... have a structure 
similar to that of the client 1-2 described above. 

Fig. 2 shows an example of an image displayed on 
the bit map display 1-23 of the client 1-2. 

A video display window 2-1 is used for displaying 
an image taken with a camera connected to an accessed 
camera server. A camera control window 2-2 is used for 
entering an acquisition request for the camera control 
right of an accessed camera or for entering a camera 
control command . 

Buttons 2-3a, 2-3b, 2-3c, 2-3d in the camera 
control window 2-2 are used for generating a control 
command of changing the image pickup direction to up, 
down, right, or left direction. By using a mouse of 
the input unit 1-26, a cursor displayed on the screen 
is moved to a button corresponding to the direction to 
be changed, and clicked to thus enter a control command 
for the image pickup direction (pan and tilt angles). 

A scroll bar 2-4 is used for changing the zoom 



magnification factor. By using the mouse, a button 2- 
4a is dragged to thus enter a control command for the 
zoom magnification factor. 

A control ON button 2-5 is used for issuing an 
acquisition request for the camera control right of an 
accessed camera (camera corresponding to an image 
displayed on in the video display window 2-1), by 
clicking this button. A control OFF button 2-6 is used 
for issuing a discard request for the camera control 
right now in possession, by clicking this button. 

A video ON button 2-7 is used for accessing the 
camera server 1-1 to receive an image taken with the 
camera 1-11. When this button 2-7 is clicked, image 
data is supplied from the camera server i-1 and the 
image taken with the camera 1-11 is displayed on the 
video display window 2-1. A video OFF button 2-8 is 
used for stopping an access to the camera server 1-1. 
A display field 2-10 is used for displaying information 
on whether the client is acquiring the camera control 
right, or other information. 

Fig. 3 is a diagram showing the software 
configuration of the camera control system of the 
embodiment. In the camera server 1-1, software of a 
video transmission server 3-11 and a camera control 
server 3-12 runs. In the camera clients 1-2, 1-3, 1- 
4,..., software of video display clients 3-21, 3-31, 
3-41,..., 3-nl and camera control clients 3-22, 3-32, 
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3-42,..., 3-n2 runs. 

The video transmission server 3-11 performs video 
data capture and compression, and transmits video data 
to an accessed camera client. The camera control 
5 server 3-12 manages acquisition requests for the camera 
control right, discard requests for the camera control 
right and the like supplied from clients in order not 
to give the camera control right to a plurality of 
clients at a time. 

10 The camera control server 3-12 performs the camera 

control in accordance with a camera control command 
entered from a client having the camera control right 
(in the example shown in Fig. 3, client 1-2), the 
camera control command including an image pickup 

15 direction, a zoom magnification factor and the like. 
When the camera control is performed, the camera 
control server 3-12 broadcasts camera parameter 
information to all clients accessing the camera server 
1-1 at that time, the camera parameter information 

20 including current pan and tilt angles, a current zoom 
magnification factor and the like. 

The video display clients 3-21, 3-31, 3-41,..., 3- 
nl receive compressed video data transmitted from the 
video transmission server 3-11 via the network, expands 

25 it, and display the image taken with the camera. 

The camera control clients 3-22, 3-32, 3-42, 
3-n2 display the camera control window 2-2 on the 



display 1-21 to provide a user interface for inputting 
a camera control command. If the client has the camera 
control right, an input camera control command is 
transmitted to the camera server 1-1. 

The operation to be executed by the camera control 
server 3-12 will be described with reference to the 
flow chart shown in Fig. 4. A control program for this 
operation is stored in the secondary storage device 1- 
17, which is loaded in RAM 1-15 and executed by CPU 1- 
15. 

At Step S410, an initialization process of the 
video camera 1-11 is performed to set specific values 
as pan and tilt angles and as a zoom magnification 
factor, and thereafter the flow advances to Step S420. 
If any event occurs at Step S420, the flow advances to 
Step S430. An event includes a command from a client 
connected to the network, a command for an operation in 
the camera server 1-1, and the like. 

If the camera control right is being granted to 
some client at Step S430, it is checked from the issued 
event whether the client having the camera control 
right is to be deprived of the camera control right. 

In this embodiment, the client having the camera 
control right is deprived of the camera control right 
under the following conditions: when the client having 
the camera control right issues the discard request for 
the camera control right; when a predetermined time 
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elapes after the client was granted the camera control 
right; when the client having the camera control right 
is physically disconnected from the network; when a 
client having a priority order higher than that of the 
5 client having the camera control right issues an 

acquisition request for the camera control right; and 
other conditions. 

If the occurred event satisfies any of the above 
conditions at Step S430, the client having the camera 
\S 10 control right is deprived of the camera control right 

JTJ at Step S430. At Step S432, a deprivation notice of 

the camera control right is transmitted to the client 
^ which was deprived of the camera control right. 

~_ At Step S440 if an event such as an acquisition 

% 4 15 request for the camera control right is issued from a 

O client, it is checked whether the client is granted the 

Qj camera control right. In this embodiment, in addition 

to an event of the acquisition request for the camera 
control right, the camera control right is granted 
20 under the following conditions: when a standby state of 
camera control right acquisition is released which 
acquisition was requested by a client; if a client has 
previously reserved camera control right acquisition; 
if any client is not granted the camera control right 
25 and when only a camera control command issued from a 
client is received; and other conditions. 

If the occurred event satisfies any one of the 



above conditions at; Step S440, a client to be granted 
the camera control right is designated at Step S441 . 
As the criterion for this designation, the camera 
control right may be granted to a client whose 
acquisition request for the camera control right was 
received earliest by the camera server, or to a client 
having the highest priority order among those clients 
issuing the acquisition request for the camera control 
right . 

At Step S442 the camera control right is granted 
to the designated client. At Step S443 a notice of 
granted camera control right is transmitted to the 
granted client. 

At Step S450 it is checked whether an acquisition 
request for the camera control right issued from a 
client is required to be registered, or whether a 
reservation for the camera control right issued from a 
client is required to be registered. If required, at 
Step S451 an acquisition request for the camera control 
right or a reservation for the camera control right is 
registered in a management list of the camera control 
server 3-12. At Step S452, a notice of registration is 
transmitted to the registered client. The management 
list registers therein information on a client granted 
the camera control right and on clients reserved for 
the camera control right . 

At Step S460 if an event is a camera control 
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command transmitted from a client granted the camera 
control right, then the flow advances to Step S461 
whereat the camera is controlled in accordance with the 
camera control command. At Step S462, parameters such 
as the image pickup direction (pan and tilt angles) and 
the zoom magnification factor of the controlled camera 
are broadcast to all clients accessing the camera 
server 1-1. 

The operation to be executed by the camera control 
client 3-22 of the client 1-2 of this embodiment will 
be described with reference to the flow chart shown in 
Fig. 5. A control program for this operation is stored 
in the secondary storage device 1-25, which is loaded 
in RAM 1-24 and executed by CPU 1-22. The clients 1-3, 
1-4,... execute an operation similar to the client 1-2. 

At Step S510, an initialization process is 
performed to initialize various parameters and flags, 
and thereafter the video ON button 2-7 is clicked to 
access the camera server 1-1. Next, an event is waited 
for at Step S520. 

At Step S530, if an acquisition request for the 
camera control right is entered by clicking the control 
ON button 2-5, it is checked whether a camera control 
right holding flag is OFF, i.e., whether the client 1-2 
has the camera control right. If not, the flow 
advances to Step S532 whereat an acquisition request 
for the camera control right is transmitted to the 



camera server 1-1, whereas if the camera control right 
is being granted, it is not transmitted. 

At Step S540, if a discard request for the camera 
control right is entered by clicking the control OFF 
button 2-6, the flow advances to Step S541 whereat it 
is checked whether the camera control right holding 
flag is ON, i.e., whether the client 1-2 has the camera 
control right. If the camera control right is being 
granted, the flow advances to Step S542 whereat a 
discard request for the camera control right is 
transmitted to the camera server 1-1, whereas if not, 
the discard request for the camera control right is not 
transmitted so that any load is imposed on the network. 

It is checked at Step S550 whether a control 
command such as an image pickup direction command and a 
zoom magnification factor command is entered by 
operating upon the buttons 2-3a, 2-3b, 2-3c, 2-3d, or 
scroll bar 2-4. 

If the control command is entered, it is checked 
at Step S551 whether the camera control right holding 
flag is ON. If ON, i.e., if the camera control right 
is being granted, the entered camera control command is 
transmitted to the camera server 1-1 at Step S552. 

If the camera control right holding flag is not ON 
at Step S551, i.e., if the camera control right is not 
being granted, the flow advances to Step S553 
( processing 1 ) . 



Fig. 6 is a flow chart illustrating the processing 
1 at Step S553 shown in Fig. 5. 

At Step S601, an acquisition request for the 
camera control right is issued and transmitted to the 
camera server 1-1. At Step S602, the camera control 
command entered at Step S530 is stored in RAM 1-24. 

At Step S603, if the notice of granted camera 
control right is transmitted from the camera server, 
the camera control right holding flag is turned ON at 
Step S604 to notify the client of that the camera 
control right can be granted. At Step S605, the camera 
control command stored at Step S602 is read and 
transmitted to the camera server 1-1. 

With the above processes, when the camera control 
command is entered even if the client has no camera 
control right, an acquisition request for the camera 
control right is first issued and then the camera 
control command is transmitted after the notice of 
granted camera control right is received. 

Reverting to the flow chart shown in Fig. 5, it is 
checked at Step S560 whether an event is a notice of 
granted camera control right transmitted from the 
camera server 1-1. If the event is the notice of 
granted camera control right, the camera control right 
holding flag is turned ON and thereafter at Step S562 
the effect that the granted camera control right is 
granted, is displayed on the display 2-10. This 



display may be performed by displaying a picture 
representative of a presence/absence of granted camera 
control right on a partial area of the display screen, 
or by changing the display style of the buttons 2-3a to 
2-3d and scroll bar 2-4 in accordance with a 
presence/absence of granted camera control right. 

At Step S580, it is checked whether an event is a 
notice of reservation of the camera control right and 
registration of the client. If the event is such a 
notice, the flow advances to Step S581 whereat the 
effect that the camera control right has been reserved, 
is displayed on the display 2-10. 

At Step S590, it is checked whether an event is a 
camera parameter notice from the camera server 1-1. If 
the event is such a notice, the noticed current image 
pickup direction including the pan and tilt angles is 
displayed on the display 2-10. 

As above, if a client enters a camera control 
command before the client is not granted the camera 
control right, the acquisition request for the camera 
control right is automatically issued and transmitted 
to the camera server so that the camera control command 
can be properly processed. 

Fig. 7 is a flow chart illustrating the processing 
1 at Step S553 shown in Fig. 5 different from the 
operation illustrated in Fig. 6. 

At Step S701, when an acquisition request for the 
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camera control right: is issued, the acquisition request 
for the camera control right as well as the camera 
control command entered at Step S550 is transmitted to 
the camera server 1-1. 

Figs. 8A to 8C show the structures of packets for 
the camera control command to be transmitted from the 
clients 1-2, 1-3, 1-4,.... Fig. 8A shows the structure 
of a packet when a camera control command is 
transmitted to the camera server. Fig. 8B shows the 
structure of a packet when an acquisition request for 
the camera control right as well as a camera control 
command is transmitted. Fig. 8C shows the structure of 
packets, a packet for an acquisition request for the 
camera control right being first transmitted and in 
succession a packet for a camera control command being 
transmitted to the camera server. 

In Figs. 8 A to 8C, a header stores information 
specific to the client such as an ID address of the 
client. A field 302 stores information specific to the 
client. A field 303 stores data necessary for an 
acquisition request for the camera control right. 

The packet shown in Fig. 8B stores information on 
an acquisition request for the camera control right and 
a camera control command, and is transmitted to the 
camera server at Step S702 in the flow chart shown in 
Fig. 7. 

For the packets shown in Fig. 8C, the packet 
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storing information necessary for an acquisition 
request for the camera control right is first 
transmitted and in succession the packet storing 
information necessary for a camera control command is 
5 transmitted, respectively to the camera server at Step 
S702 in the flow chart shown in Fig. 7. 

In the operation to be executed by the camera 
control client illustrated in the flow chart of Fig. 7 , 
the acquisition request for the camera control right 
io and the camera control command are transmitted at the 

.nn same time or in succession to the camera server. 

Therefore, the camera server can advantageously perform 

Yf B the camera control in accordance with the camera 

control command immediately after the client acquires 

7^ 15 the camera control right. 

Q In this embodiment, as shown in Fig. 2, the camera 

SB control command can control the image pickup direction 

and zoom magnification factor of the camera. Other 
camera control commands may also be used, such as a 
20 focus control command, a switch command between manual 
and automatic focus controls, and a shutter speed 
control command. Also in such a case, an acquisition 
request for the camera control right can be 
automatically issued and transmitted to the camera 
25 server as in the above embodiment, if the camera 

control right is not still granted when such a camera 
control command is entered. 
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Also in the above embodiment, although only a 
single camera server is connected to the network, a 
plurality of camera servers may be connected to the 
network and the camera control right for each video 
camera connected to each of the camera servers is 
requested. Also in such a case, the object of the 
embodiment can be achieved by automatically requesting 
the camera control right to each accessed camera server 
connected to the network even if the camera control 
command is entered before the camera control right is 
still not granted. 

In the embodiment described above, the camera 
server 1-1 notifies the acquisition of the control 
right of the video camera 1-11 to each client. 
Instead, the camera server 1-1 may not notify the 
acquisition of the control right of the video camera 1- 
11 to each client. 

In this case, the client transmits the control 
command for the video camera 1-11 by using the packet 
of the control command shown in Fig. 8A. Upon 
reception of the packet shown in Fig. 8A, the camera 
server 1-1 reads the ID address in the header 301 of 
the received packet to identify the client which 
transmitted the control command. 

In this case, the object of the embodiment can be 
achieved by performing any of the following operations: 
(1) if there is currently no client which is granted 



the camera control right, the camera server 1-1 grants 
the camera control right to the client which 
transmitted the control command and controls the video 
camera 1-11 in accordance with the control command, (2) 
if the camera control right is already granted to the 
client which transmitted the control command, the 
camera server 1-1 controls the video camera 1-11 in 
accordance with the control command, as usual, and (3) 
if the camera control right is already granted to 
another client, the control command other than that 
transmitted by the client with the camera control right 
is invalidated. 

The invention is also applicable to a system or 
apparatus whose computer ( or CPU or MPU ) runs to read 
and execute software programs realizing the functions 
of the above-described embodiment and stored in a 
storage medium . 

In this case, the software program codes 
themselves read from a storage medium realize the 
embodiment functions. Therefore, the storage medium 
storing such program codes, constitute the present 
invention. 

The storage medium storing such program codes may 
be a floppy disk, a hard disk, an optical disk, a 
photomagnetic disk, a CD-ROM, a CD-R, a magnetic tape, 
a non- volatile memory card, and a ROM. 

The scope of the invention also includes only the 
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case wherein the embodiment functions are realized by 
executing the program codes read by the computer but 
also the case wherein the embodiment functions are 
realized by the process, a part or the whole of which 
process is executed in accordance with the program 
codes, by an OS (operating system) on which the 
computer runs . 

Furthermore, the scope of the invention also 
includes the case wherein in accordance with the 
program codes stored in a memory of a function 
expansion board or unit connected to the computer 
supplied with the program codes, a CPU or the like of 
the function board or unit executes part or the whole 
of the actual tasks for realizing the embodiment 
functions . 

In applying the embodiments to a storage medium, 
the program codes corresponding to the flow charts 
described above are stored in the storage medium. In 
short, modules essential for the camera control system 
of this invention is stored in the storage medium. 

As described so far, according to the embodiment, 
an acquisition request for the camera control right is 
automatically transmitted to the camera server even if 
a camera control command is entered before the camera 
control right is still not granted- Accordingly, a 
user can uses the camera control system freely and with 
ease . 
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Many widely different embodiments of the present 
invention may be constructed without departing from the 
spirit and scope of the present invention. It should 
be understood that the present invention is not limited 
5 to the specific embodiments described in the 

specification, except as defined in the appended 
claims . 
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